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Abstract 

A convergent iterative process is constructed for solving any solvable linear 
equation in a Hilbert space. 

1 Introduction 

A basic general result about solvable linear equations 

An = f, (1) 
where A is a linear bounded operator in a Hilbert space, is the following theorem. 

Theorem 0. Any solvable equation (JTJ with a bounded linear operator can be solved by 
a convergent iterative process. 

A proof of Theorem El can be found, e.g., in [2j. One of the steps in this proof is the 
following simple Lemma (see e.g. [2]). 

Lemma 1. If equation is solvable and A is a bounded linear operator, then equation 
(0) is equivalent to 

A*Au = A*f. (2) 
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The equivalence in Lemma Q means that every solution to (|TJ solves (J2J) and vice 
versa. 

The aim of this paper is to study equation ((TJ with a linear, closed, densely defined, 
unbounded, and not necessarily boundedly invertible operator. In other words, A may 
be not injective, i.e., null space iV := N(A) may be non-trivial, and its range R(A) may 
be not closed. Although there are many papers and books on iterative methods, iterative 
methods for equations (JTJ) with unbounded operators were not studied in such generality. 

Our second aim is to study a variational regularization method for the solutions to 
equation (JTJ). By y we denote throughout the unique solution to (JTJ) of minimal norm, 
i.e., the solution y _L iV '. This solution will be of main interest to us. If A is bounded, 
but not boundedly invertible, so that (JTJ) is an ill-posed problem (see e.g. then a 
variational regularization method for obtaining a stable approximation of the solution y 
given noisy data fs, \\fs — f\\ < S, consists of 

a) minimizing the functional 

F(u) = \\Au- f 5 \\ 2 + a\\u\\ 2 , a>0, (3) 

where a is a constant called a regularization parameter, proving that (J5J) has a unique 
global minimizer u a ,s = (A* A + aI)~ l A*fs, 
and 

b) proving that one can choose a = a(5), so that lim^o a (^) = and 

lim ||u«y — y|| = 0, u s : = u a i 5 Y s- (4) 

Formula (j3J) shows that us is a stable approximation of y. The rate of convergence of 
us to y is not possible to specify without imposing additional assumptions on /. 

If A is unbounded, then it was not proved that functional © has a unique global 
minimizer. Formula u a g = (A* A + aI)~ 1 A*fs is not well defined because fs may not 
belong to D(A*). 

Throughout the paper T = A* A is a selfadjoint nonnegative operator (generated by 
the closed nonnegative quadratic form (Au,Au), D(T) C D(A), T a := T + al, I is the 
identity operator, Q = AA* > is a selfadjoint operator, D(Q) C D(A*). Recall that 
A* is well defined if A is densely defined, and A* is densely defined if A is closed. (See 
PP). By So we denote the operator T~ 1 A* with domain D(A*), and by S we denote its 
closure. 

Our results can be described as follows: the operator So is closable, its closure is 
defined on all of H and is a bounded operator, \\S\\ < ^K^. A similar result holds for 

Si = T^ a l A* with domain D(A*). Our result shows that the element T~ 1 A*fs is well 
defined for any fs G H, and not only for fs G D(A*). 
Consider the iterative process 

u n+1 = Bu n + T^A*f, ui = ui, a> 0, (5) 

where the initial approximation u\ _L N and otherwise arbitrary, and B := aT~ l . 
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Theorem 1. If A is a linear, closed, densely defined operator in H, a > 0, B = aT a l , 
and u\ _L N , then 

lim \\u n - y\\ = 0, (6) 

where u n is defined by (5). 

Theorem 2. If A is a linear, closed, densely defined operator in H , and a > is a 
constant, then the operator Sq = T~ X A* with domain D(A*) is closable and its closure S 
is a bounded operator defined on all of H , \\T~ 1 A*\\ < Similar results hold for the 
operator A*. 

Theorem 3. For any fs G H functional (JHJ) has a unique global minimizer u a s = 
T- 1 A*f s = A*Q- l fs. 

In Section 2 proofs are given. In Section 3 we construct a stable approximation to 
y given noisy data fs and using an iterative process similar to (J3J). In Section 4 the 
case of selfadjoint, unbounded and possibly not boundedly invertible operator is briefly 
considered. In Section 5 the dynamical systems method (DSM) (developed in [2] pp. 41- 
70) is justified for equation (1) with unbounded, linear, densely defined operator in a 
Hilbert space. The basic results of this paper are stated in Theorems 1 through 5. 



2 Proofs 

Proof of Theorem^ To prove the closability of So, assume that u n G D(A*) = D(So), 
u n — > 0, S u n f, and prove / = 0. We have 

(/, h) = lim (S u n , h) = lim (A*u n , T~ x h) = lim (u n , AT~ l h) = 0, V/i G H. (7) 

n^oo n-^oo n— too 

Here we have used the inclusion RiT' 1 ) C D(A). This inclusion can be verified: if g = 
T~ x h, then Tg + ag = h, so g G D(T) C D(A), as claimed. From it follows that / = 
because h G H is arbitrary. Relation ([JJ shows that D(Sq) = H and Sq = AT" 1 . This 
operator is closed and densely defined. Indeed, by the polar decomposition, A = UT?, 
where U is a partial isometry, \\U\\ < 1. The operator T^T~ X is densely defined, it is a 
function of the selfadjoint operator T. We have 

ira^p^zriHi / -?—dE.\\ = sap - 



>o s + a lyfa 

where we have used the spectral theorem and E s is the resolution of the identity of the 
selfadjoint operator T. Since || S\\ = \\S?\\ = \\Sq\\ < 27s, Theorem His proved except 
for the claim concerning the operator T~ l A*. The proof of this claim is essentially the 
same as the above proof, the only (not important) difference is the replacement of the 
formula (T" 1 )* = by (T^J* = T^. 

Theorem |21 is proved. □ 
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Proof of Theorem^ If equation (JTJ is solvable then / = Ay, the operator B = aT^ 1 is 
bounded, defined on all of H, and ||5|| < 1. 
Consider the equation 

u = Bu + T~ 1 A*f. (9) 

This equation makes sense for any / G H by Theorem The minimal-norm solution y 
to equation (JTJ) solves Q in the following sense. 

If / G £>(A*), then = A*f, ay + Ty = ay + A*f, y = By + T~ l A* f , so y solves ® 
if / G D(A*). Since the set / G fl-R(^) = £>(T) is dense in # and, consequently, 

in jD(A*), and since, by Theorem |2l the operator S = T~ X A* is uniquely extendable to 
all of H (from a dense subset D(A*)) by continuity, it follows that if y solves equation Q 
for every / G D(A*) f)R(A), then this equation is solvable for any / G R(A). Indeed, 
suppose u n = Bu n + Sf n , f n G D(A)f ]R(A), u n _L iV, and linin-oo fn = f € R(A). 
The subspace N 1 - := NiT) 1 - = R(T) is invariant with respect to B. If / G -R(A) 
and / = Ay, then equation Q has a unique solution u G iV- 1 , and this solution is 
u=(I-B)- 1 T- 1 Ty = y. 

Indeed, 

(/ - BY^Ty = (I- aT-rVTy = f°° ^f— - = y 

Denote w n := u n —y. Then (jSJ) and equation Q for y imply u> n+ i = Bw n , so u> n +i = B n w, 
w := Ui — y, w -L N. 

Let us prove lim^oo ||.B n i(;|| = 0. If this is proved, then (JHJ) follows, and Theorem ^ 
is proved. We have 

I := \\B n w\\ 2 = [°° ^ d(E 8 w,w) = [ + [ :=h + h (10) 
J [a + s) J s > b Jo <s <b 

where b > is a number and E s is the resolution of the identity corresponding to the 
self adjoint operator T > 0. 
In the region \s\ > b one has 

a 2 

h < q n {b)\\w\\ 2 , 0<q<l, q = q(b) = max - ; — . (11) 
We estimate 7 2 as follows: 



|s|>b (a + s) 2 ' 



h < I d(E s w,w) (12) 



uniformly with respect to n. 
Since w _L N, we have 



lim / d(E s w,w) = \\P N w\\ 2 = 0, (13) 
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where P^ = E +0 — E is the orthoprojector onto N, and 




because E s _ = E s . Therefore, for an arbitrary small e > 0, we choose b > so small 
that Ii < |, and for fixed 6 we choose n so large that q n (b) < |. Then I < e. 

Theorem ^ is proved. □ 

We could replace a by ia in the above arguments. 

Proof of Theorem^ Denote f$ := g and -u^ := 2 := A*Q~ x g. The operator ^Q" 1 = 
VQ2Q- 1 , where V is a partial isometry, so H^*^ 1 )! < HQ 2 ^ 1 !! — 573" Thus, z is 
defined for any g E H . We have 

F(z + /i) = F(z) + \\Ah\\ 2 + a\\h\\ 2 + 2Re[(Az- g,Ah) + a(z,h)\ VheD(A). (15) 

If z = A*Q~ 1 g, then 

{Az - g, Ah) + a{z, h) = {QQ^g - g, Ah) + a{Q- l g, Ah) = 0. (16) 

From ()15|) and ()16j) we obtain 

F(z + h)> F(z) V/i G D(A) (17) 

and F(z + h) — F(z) implies h = 0. Thus z is the unique global minimizer of F. Let us 
prove A*Q~ X = T~ X A*. Since both operators in this identity are bounded, it is sufficient 
to check that 

A*Q- V = T~ x A*i> (18) 

for all ip in a dense subset of i7. As such dense subset let us take D(A*). Denote 
Qa 1 ^ '■= 9- Then ip = Q a g- Equation (fTHj) is equivalent to 

T a A*g = A*Q a g, or A*AA*g + aA*g = A*AA*g + aA*g, 

which is an obvious identity. Reversing the steps, we obtain (|18|) for every if) G D(A*). 
Note that -0 G is equivalent to g G -D(A*AA*), so that the above calculations are 

justified. 

Theorem |H] is proved. □ 

Equation (|18|) allows one to replace the term T~ x A*f in ((HJ) by the term A*Q~ l f 
which is originally well defined for any / G H. 
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3 Stable solution of (1). 



Suppose that noisy data fs, \\fs — f\\ < S, are given. We want to construct a stable 
approximation ug of y in the sense (|4"j). 

One way to do this is to use iterative process (J5J), with fs in place of /, and stop 
the iterations at the step n = n(5), where n(6) is properly chosen. Indeed, if we use the 
argument from the proof of Theorem then we get w n+ i = Bw n + S(fs — /). Thus 
Wn+i = J2]=o Bj S(fs - f) + B n w, where w = u\ - y, u x _L TV, and 

II £ B*S(J, -f)\\< + e(n) := u(S, n) 

where lim^oo e{n) = 0, as we have demonstrated in the proof of Theorem ^ 

It is clear that if n = n(S) is chosen so that lim^ n {d) — 00 an d lim^^o Sn(8) = 0, 
then lim^o u(5, n(5)) = 0. Therefore u$ = u n ^) satisfies (HJ). 



4 Equation (1) with selfadjoint operator. 

Assume that A = A*, A is unbounded and A does not have a bounded inverse. Then 
one can use an analog of Theorem in the form 

u n+ i = Lu n + g, L := ia(A + iay 1 , g=(A + ia)~ 1 f, (19) 

where a = const > and u\ _L iV := N(A) is arbitrary. Note that any element Ah, 
V7i G D(A), is orthogonal to iV since A = A*. The minimal-norm solution y to ((J) solves 
the equation y = Ly + g, so that the proof of Theorem ^ remains almost the same. So 
we get 

Theorem 4. If A = A* is unbounded, a = const > 0, and equation $IJ is solvable, then 
© holds for the iterative process (|T9*|) . 

Also an analog of the result of Section 01 holds. 



5 DSM 

In this Section we justify the dynamical systems method (DSM) for solving equation (|T|) . 
The DSM theory is developed in [2], pp. 41-70. 

Theorem 5. Assume that f = Ay, y _L iV , TV := N(A), A is a linear operator, closed 
and densely defined in H . Consider the problem 

du 

u = -u + T £ -,U*f, u(0)=u ; u:=—, (20) 
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where Uq G H is arbitrary, T £ = A* A + el , e = e(t) > is a continuous function 
monotonically decaying to zero as t —> oc, and J* °° e(s)ds = oo. Then problem (j2T)|) has 
a unique solution u(t) defined on [0, oo), there exists 

lim u(t) := w(oo), and u(oo) = y. (21) 

t— >oo 

Proof. One has T~,\A*f = Tj\Ty. Therefore 

u(t) = u Q e- f + f e-^T^Tyds. (22) 

J 

The conclusion of Theorem |S] follows immediately from two lemmas: 
Lemma 2. If there exists h(oo) = ]xm t ^ too h(t), then 



lim / e- (t - s) h(s)ds = h(oo). (23) 

t^ooJ Q 

Lemma 3. If y ± N := N(A), then 

YmvT^Ty = y. (24) 

The proof of Lemma 121 is simple and is left to the reader. 
The proof of Lemma H3 is briefly sketched below:: 

T- x Ty -y= f (-?— - l) dE s y = - [ -^—dE s y. 
Jo \s + e J J s + e 

Thus, 

lim \\T^Ty - yf = lim f° t&jll = || P ^ f = , (25) 
e^o 6 ^°Jo {s + e) z 

because y _L N. The projector P^ is the orthogonal projector onto N. 

Theorem El is proved. □ 

One can use Theorem exactly as it is done in [2], for stable solution of equation (JTJ) 
with noisy data: if f$ is given in place of the exact data /, \\f$ — f\\ < 5, then one solves 
problem (|2"U|) with f$ in place of /, calculates its solution ug(t) at t = t$, and proves that 

lim \\u s (t s ) -y\\ = (26) 
S— >o 

if ts is suitably chosen. The stopping time t$ can be uniquely determined, for example, 
by a discrepancy principle as shown in [2j for bounded operators A. The argument in [2] 
remains valid in the case of unbounded A without any changes. 
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